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ABSTRACT. The paper describe* seme experiments with a visual agn.os.ia patient who 
has tee* the ability to perceive subject conwuri. The patient's interpretations of simple 
example* Of exclusion lndica.se that he fail* to notice monocular CffWiton clues, as well. 
The finding* support the hypothesis that subjective contours are constructions that account 
for occluded figures* tn the absence or objective edges. The patients ability to P erce|V ® 
contours by jie'rwpsis demonstrates that itereopsLs independently gives me to du^artfji 
contours* Furthermore, Che overall result* strongly suggest that the oetection or occlusion is 
modular Lied, and That the module for detecting monocular occlusion clues is not the wrne as 
Chat which provides occlusion dues on the basis of stereopsis. 


Thl* report describes research done at the Artificial Intelligence Laboratory of the 
Massachusetts Institute Of Technology. 


INTRODUCTION 


Sulfajective toniaim ate clearly nn^rucr^itA An edge is perceived where no 
wntrasL is present. It is unlikely that these contours are merely artifacts that arise from the 
partial activation, of edge or line masts [Kanlisa, 1$T0; Mart* ISfal It has been suggested 
char subjective contours arise during Che inlerprclaLiCin of depth cues: ~.,A subjective ccnabitr 
1} simply the edge of a subjective plant, and a subjective plant is a surface which ought to be 
present 071 the basis of available depth tutl, &«t if noi except ift the mind of the perceioer' 
[Cored. 19721 

Mur has suggested that subjective contours are constructed from groupings of 
plate tokens. In figure 1, for example. thE place tokens are the endpoihts of the radial lines. 
Points, blobs, and even small forms can act at place tokens tfi contributing towards 
groupings. 

Similar groupings can be seen in dot patterns. In figure 2 groupings of dots give 
rise to concentric and radial patterns- Like subjective contours, these patterns do nut persist 
under scrutiny. 

The similar impressions given by subjective contours and groupings of dots 
suggests that they are generated by a common grouping mechanism. However, unlike 
simple groupings, whether or not one perceives a subjective contour as apparently related to 
flgure-grcwid decisions. It as therefore useful to distinguish between the method by which 
they ire cenifrycfi^, and the criteria that leads to their perception. A visual agnosia patient 
has provided some evidence of the latter- 



Figure 3 [after Marr, The grouping of place totem into a curvilinear aggregation n 
probably rwcesary to define the shape of a subjective contour, bur more than grouping it 
involved in ics perception- In this figure, the endpoints at rhe lanes not only aerve as place 
tofcens f&r grouping, but as I^cat evidence of perfusion. as well a compelling^Y.jure-frafuwf 
interpretation therefore takes the central region as a figure, wherein It IS seen to be brighter 
and nearer than the radial lines which if partially obscures. If however, one ignores the 
occlusion dues and interprets these tine segments as individual figures fin which case the 
central region is ground^ rhen the subjective contour is not perceived. The patient was 

capable only of the latter, two-dimensional interpretation as evidenced by his descriptions 
over several trials. 

Figure 2 [after Glass Ec Peiei, I9731 Given two copses of a random dot pattern* if one is 
rotated and superimposed on the other, then a concentric pattern results, A radial pattern 
arises if one scales rather than rotates one of the patterns. Groupings imposed dr random 
dot interference patterns give rise to perceptual effects that are similar ro subjective 

contours: the illusion does hot persist under scrutiny, and yet presents itself strongly in non- 
fovea] vision. 
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EXPERIMENTS 


A patient has evidence of occlusion to the left posterior cerebral artery which 
caused infarction tp (he left media] occipital legion, and suggestions of other disease to the 
posterior hemispheres bilaterally. As a result. he has partial right heteronymous 
hemianopsia* visual agnosia, and amnesia. Relevant to this discussion is that fie d&es not see 
sufyeeftw MnrniiTj. 

in spite of hU agnosia, his ability to describe drawings is good, especially since he 
has artistic gill and, discusses drawings in terms of ‘shading*, H form' and so forth. 
Furthermore, he jj alert, intelligent. and cooperative. Throughout these experiments, he 
Was unaware that his perception of subjective contours and occlusion was being 
investigated. Rather, he believed that his visual acuity was being tested. 

Two series of presentations were made. The first consisted of subjective contours 
[see Kanizsa, 19.76. pp 43*51; and Marr, 1975, p. SO] and random dot interference patterns [see 
Class Se Perez, J973 f p. 3G]], The second series consisted of computer generated stereograms 
fs« figures 7-10), Included as well were random dot stereograms [Julesi. 1971] of a dish and 
a square. Ali stereograms were presented to the patient as transparencies, using a Realist 
Stereo viewer. 

The patient’s amnesia allowed repeated testing with differing verbal approaches. 

far rarely did he remember having seen a given figure, even if it had been presented only 
minutes before. 



RESULTS 


Subjective con Lours 

The initial series of presentation! revealed that the pattern perceived no edge 
where one normally stes a tubjectjve eontcwi. Various approaches were taken to verify 
this, and I am confident that no edge* line, or boundary could be vlsualiied by the patient, 
even when it was suggested that a "thin wash of grey' had been applied to one side of the 
contour, and that he "should be able to see the contrast’, 

tn figure 3> for example, the terminations of the horizontal lines usually give rise 
to subjective contours, Those terminations that follow the sinusoid are especially effective 
in suggesting an edge, with illusive impressions of contrast aCCOM the edge.. The patient 
described The figure in constructive two-dimensional term-tv indicating how the lines on the 
left were apparently shifted laterally with respect to those on the right. While he noticed 
that the boundary between them was curved, it was dear that he did not see any edge nr 
contrast effects; he described the curved boundary a* being defined only by the way the 
lines terminated, and that between the endpoints {along the curve) the brightness was the 
same as elsewhere in the figure, No “illusive contrast’ was seen- 

Not surprisingly therefore, forms composed of subjective contours were never 
seen by him. Examples of these are the iUnizsa triangle (see one side of the stereo pair in 
figure 9), rectangle (figure $} t the disk in Figure l, and the pear-shaped form in figure S. 
The location of a tvbjtciivt form cuuld be understood only after its vertices were laboriously 
pointed out and its periphery traced. Even then, It evidently could not be visualiied. for it 



would ruH appear n««r or brightEr. rtHr woul d it ^ „ occluding the background 

for mi. 

Decision 

Ai ™°™ d ‘ the of the Kaniua mangle and rectangle showed that 

wupltd with net seeing the subjective forms, the patkm failed as wetl to interpret the 
SU rro un d.ng patterns as partially occluded figun* For example, the Kantisa triangle 
illustration was interpreted as three irregular black forms and wiqus line segments. When 
«ked to further describe the black forms, his d HCf jp !io n was in terms of what was UtcreUy 
presented, and not in terms of partially obscured disks. The line segments were described 
as three disjoint angles or corners (indicated by gesticulation). He rejected the suggestion 
thai they might be the vertices of a triangle, for the sides were obviously incomplete! This 
fragmented global interpretation persisted during subsequent retrials with the Illustration 
presented at varying distances from the patient. Similarly, the Kimzsa rectangle illustration 
was consistently described as four stripes and four lines. His Failure to include occlusion in 
his interpretations was explored further. 


The patient's first impressions of figure 1 were as follows; 
lease dEscribe what you see." 

* * 4 ‘ •** ^ J0 ,i( «*»/ -** 

'Where’s the smalfer circle?' 

™ 71151 4 It's fist naf Aar A«n drazuir tht rr.“ 


This is an accurate description of figure 1. of course. However one usually arrives at a 
simiplier interpretation as well: chat of a white disk occluding she center of a radial pattern 
of lines. At least, if this interpretation does not occur immediately, Lt can be ptrceived once 
Migrated. Ye: the pattern could not perceive the occlusion interpretation, even when it was 
described in detail, It could be understood only after E demonstrated it repealedJy with a 
smalt disk of paper on a hand-drawn radial pattern. Thu interpretation seemed to come to 
him as a revelation. 

Over several trials* figure i was interpreted consistently as two- rectangles and a 
square, and not as a square partially occluding a rectangle, even when the latter 
interpretation was verbally suggested, The ocrliiiion interpretation was demonstrated, as 
before, with two pieces of paper. After some effort, he understood how that interpretation 
could apply to the line drawing, Yet laLer. When asked to draw the Figure, although he took 
care to duplicate the aspect ratios of the three rectangles, the lines that correspond to 
occluded edges were not made cull inear. 

Further evidence of his inability m perceive occlusion came in figure 5 wherein 
he never interpreted the black forms as partially obscured disks. Yet he was immediately 
impressed by the pear-shaped central region. Hr did not consider it to be a figure, 
however, for Lt wai nw complete: its boundary wu suggested only in places (where the 
disks were occluded). Each such edge was noted as either being convex or concave (not his 
words, rather he noted this by gesticulation) rti&liut la the Mack forms, and not to the pear* 
shaped region. Therefore, it was evident that each edge was not seen as an occlusion edge, 
but merely as part of the boundary of a black form, Globally, he interpreted figure £ as an 
arrangement of curiously shaped forms. No Variation in this interpretation came from 


Figure i {after Marr, IS’JSJ, The terminated lines gLve rise ct> two vercical mbjeciive 
contours, arid a sinusoidal subjective contour, The latter is especially effective In 
suggest mg an edge, IF the figure is interpreted at one grid above another. The patient 
described the figure only in terms of a two-dimensional arrangement of grids, and could see 
no subjective contours. 

Figure i. This can be interpreted as a Square partially occluding a rectangle, or as two 
rectangles abutting a square if one does not take the alignment and T-junctions as evidence 
far occlusion. The patient was capable Only of the tatter, two-dimensional interpretation. 

FigurE h [from Kanitsa, IS'JSj. Various occlusion dues give rise to the compelling 
interpretation of a pear-shaped form in front of a collection of black disks. The patient 
never came to this interpretation, nor did he see the subjective contours. 

Figure 6 [after Kamzsa, lP'JSl Rather than see i transparent rectangle above black disks, 
the patient described the figure in terms Of grey and black forms, noting how each pair of 
forms together made a circular form. The grey-black boundaries were seen to partially 
dcFine the perimeter of a rectangle, as weL|. 
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varying his distanet from the figure. 

In fLgure 8, mu ally interpreted as a translucent rectangle lying' over various-siied 
b]iiik disks, the partially obscured (grey) portion of each disk was seen as a separate figure 
frftrn the black portion, Yet he noticed Chit the grey and black portion* together deFined 
Circular forms. More globally, he noted that the grey-black boundaries partially defined ihe 
perimeter of a rectangle. Amaiingly. in spite of fail precise observations, he did not see the 
transits cent rectangle, 

Random, dot interference pa Herns 

After the subjective contours, the dot patterns were presented. The patient had 
no difficulty in seeing the radial, spiral, and circular patterns. The 'centers" of the radial 
and circular patterns were noticed immediately, followed by descriptions of the flow 
patierns. Gesticulation indicated his perception when the terminology (eg., "spiral') was not 
recalled. In those cases where one usually sets a pattern, the patient did a* well, and in 
those- where there was no global pattern, various local groupings were noticed. 

The second series of experiment! 

It was discovered that in the interim between the first and second series of these 
experiments, the patient had been shown a large number of examples of simple figures 
occluding other simple figures. He could now respond, for example: "that is a rectangle 
above a Triangle", However, there was strong evidence that this was only an intellectual 
achievement on the order of his noticing appendages on either side of a Simple figure, and 


determining the geometry of the occluded figure by counting the visible vertices: He failed 
to notice (be fetk or smooth con tirtuition when the two portions of ihe occluded figure were 
actually shifted relative to each other. Alio, if The occlusion was considerable, or If she 
occluded figure WiS not Simple, then his description was inaccurate. 

Stereopsix 

The patient's stertopsli was rested with two random dot stereograms. Both were 
successfully fused, with the disk and square seen as suspended in front of the background. 
These stereograms were composed of black squares (fandom dot density was 50 percent), 
and the 100 by 100 matrix subtended the full field of the stereo viewer. Given this coarse 
dot pattern,, if out were to foveate an the boarders of the square and disk, they would 
appear ragged and discontinuous in places, but would usually appear smooth and 
continuous in non-foVeal vision- However, the patient only saw them as ragged and 
discontinuous. 

The patient's stereopsis having been established, the stereogram versions of the 
subjective disk, square, and triangle (figures l r & and 0) were presented. They appeared to 
the patient as if they were "cut out of white paper and suspended", Tftt edgu of ?4*se 
figures were Seen as th&Tpand distinct. Figure 10* after same difficulty* was interpreted as a 
rectangle suspended in front of disks. Figures II and 12 are his renditions of the 
stereograms of figures 9 and Id. 

The underlying forms in figures 3 and 9 were seen as occluded. For example, in 
figure £, the background was described as a black cross, with horizontal and vertical Linci. 


Figure 7, This is a stereogram version of figure L. The disparity ronWHr which deimes the 
perimeter Of the disk was perceived by [he patient while the sub^Ctive cwitcyur in figure 1 
■was noc. In stereo, the disk appeared as if it were "cut out of paper and suspended . No 
dsik was seen in figure I. 

Figure 5 [after Kaniim, 1976], Thl4 IS a stereogram version of the Kannsa rectangle. In 
sharp contrast to the patient's inability to perceive the conventional version, the patient 
perceived the stereo subjective rectangle as having sharp edges, and as occluding the 
underlying forms. 

Figure 9 [after Kanitsa, L97o]. The patient saw the stereo Kan Lisa triangle as suspended in 
front of three disks and a line-drawn triangle. His interpretation of the conventional 
Vernon had been totally fragmented, with no disks or triangles seen. 

Figure 10 [after Kaniisa, l$76l While in this stereogram version of the transparent 
rectangle illustration the patient had difficulty in seeing the rectangle as being in from of 
the disks, he did perceive the edges of the dLsk as distinct. 

Figure II This is the patient’s rendition of the fLgure 9 stereogram. The mangles were 
drawn first, followed by the three disks,. The background triangle was then empbasiled, 
with the saw-tooth artifact of the- computer-generated stereogram included. 

Figure 12- The patient's rendition of the figure [0 stereogram, The rectangle was drawn 
first, with the disks plated liter. 
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Figure 0 




Figure 10 










Figura 12 









CONCLUSIONS 


Subjective contours *rise s in put, from occlusion clues 

The results support the hypoehesis that subjective contours constructions that 
accoii nt for eluded figures, hn the abience of objective edges. Visual evidence that a 
ftgur* Lt partially obscured gives rue to the need to VuptilT the obscurant. The 
pumn't inability in perceive subjective contours can be explained by his Inability to notice 
fwiuuufar Mcluito* tluti: If he were not n se= these dues, he would have no need to 
construct the subjective contours. 

The patient was able to perceive groupings in dot patterns, the sinusoidal 
terminations of lines in figure ^ and the alignment of edges m Figures 6 and T„The overall 
shape of regions wold be described, even when the region was not bounded by an 
objective contour. These curvilinear groupings of various place tokens may be the 
prauTtwi tf SMW-cttw amteur* That it, when occlusion cannot be VaptamM" by m actual 
edge of some occluding rigure, then these groupings are the next best evidence for an edge, 

hence are visisaliied as subjective contours- 

Stereopsis independently gives rise to contours 

Evidently depth ordering by sterwpsu independently provides occlusion clues, 

and these clues allowed the patient to interpret the stereograms as fi * uw * P artllU ? 
occluding other figures. The distinctness with which the patient saw the contours in the 
stereograms indicates that the* disparity mtotri are not subjective contours: they are 



Constructed on the basis of different dues. 


Th. patlan, saw Ihe boundacies of a, random do, JtBMgI , m flgllr „ as ^ 
Th.s Shgge,,, that our tendency ,0 see Jules, fig„ ra as having OTMttl boundaries ( „ Mp| 
ynder aaMnjtt is probably attrituable cosubjectiv. 

Tl» decoction of (monocular) occlusion is modoliriied 


Tht results of the hist sene, „f presentations indicated that a number nf 
monocular occlusion clue, were no, used b, ihe pa„ent. These include: line terminations 
(•nth or without smooch continuation); T-junction* concavities in. or mutilations to, 
otherwise convea (and simple) figures; and unclosed figunrs. These various dues 
contribute toward a common function; the detection of occlusion. The patient's failure to 
use sny of them suggest, the possibility that a single module unities these clues so prov.de 
occlusion information, which in lorn comributes cowards > global figure-ground 

interpretation, furthermore chi, module is probably not the same as chat which provide, 
occlusion due? On the basis of stereopsis. 
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